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INVARIANCE ENTROPY FOR CONTROL SYSTEMS* 

FRITZ COLONIUSt AND CHRISTOPH KAWANt 


Abstract. For continuous time control systems, this paper introduces invariance entropy as a 
measure for the amount of information necessary to achieve invariance of weakly invariant compact 
subsets of the state space. Upper and lower bounds are derived; in particular, finiteness is proven. 
For linear control systems with compact control range, the invariance entropy is given by the sum of 
the real parts of the unstable eigenvalues of the uncontrolled system. A characterization via covers 
and corresponding feedbacks is provided. 
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1. Introduction. This paper is concerned with the amount of information nec- 
essary to keep a continuous time control system in a given subset Q of the state space. 
We introduce “invariance entropy” that measures how often open loop control func¬ 
tions must be adjusted in order to avoid exit from a subset Q of the state space. Due 
to the analysis of the open loop problem this information measure does not depend 
on a specific class of feedback strategies and hence is intrinsic. 

The increasing relevance of control systems with restricted digital communication 
channels has spurred interest in the information necessary for accomplishing control 
tasks. Early contributions are due to Delchamps [7], who considered quantized feed¬ 
backs for stabilization. Wong and Brockett [16, 15] study the influence of restricted 
communication channels. For the present paper, the work by Nair et al. [11] and Nair 
and Evans [9, 10] is fundamental. They develop a method to describe data rates nec¬ 
essary to render subsets Q of the state space invariant. Their approach is based on 
a notion describing for discrete time systems how many feedbacks defined on open 
covers of Q are necessary in order to make Q invariant (or asymptotically stable) up 
to time N ; then they let N tend to infinity and take the infimum over all covers and 
obtain what they call feedback entropy. In particular, they show that this number is 
equal to the minimum data rate for a symbolic controller rendering Q invariant. 

The present paper introduces various versions of open loop entropies and discusses 
their relations. Since topological entropy is a property of dynamical systems (see, e.g., 
Adler, Konheim, and McAndrew [2], Robinson [13], or Katok and Hasselblatt [8]), it 
would appear that a view of control systems as dynamical systems might be helpful. In 
fact, including the time shift along control functions, one obtains a dynamical system, 
the control flow (cf. Colonius and Kliemann [4]). This point of view is helpful in order 
to adapt several constructions traditionally used for topological entropy to control 
systems. 

A preliminary definition of our information measure (see section 3 for precise 
definitions of invariance entropy) is the following: For systems with compact control 
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range let Q be a compact subset of the state space. Then, for T > 0, we let r; nv (T; Q ) 
be the minimal number of controls u £ U such that for every initial value x £ Q there 
is u with corresponding trajectory ip(t,x,u) £ Q for all [0,T]. Then we consider the 
exponential growth rate of these numbers as T tends to infinity, 

lim sup ^ In r inv (T;Q). 

T—>oo 1 

A characteristic feature of this information measure is that no information on the 
present state of the system is involved. Our main results provide upper and lower 
bounds for the invariance entropy; in particular, it is shown that the invariance en¬ 
tropy is finite. For linear control systems (with compact control range) the invariance 
entropy is given by the sum of the real parts of the unstable eigenvalues. We remark 
that Nair et al. [11] also have a similar result for feedback entropy of linear control 
systems; however, they show this only for vanishing control range, not for arbitrary 
compact control range. Finally, we can also give a characterization of invariance en¬ 
tropy in terms of covers and a feedback construction akin to the contribution in [11]. 

The structure of the paper is as follows. Section 2 recalls some basic properties of 
control systems (mainly for notational purposes) and also recalls Bowen’s definition 
of topological entropy. Section 3 introduces several variants of invariance entropy and 
their properties. Section 4 provides lower and upper bounds for the invariance entropy 
which can be computed directly from the right-hand side of the system. In particular, 
it is shown that the invariance entropy is finite. One of these bounds, together with a 
classical result by Bowen on entropy of linear maps, is used in section 5 to compute the 
invariance entropy of linear control systems. Finally, section 6 gives a characterization 
in terms of feedbacks defined on covers. 

Notation. We write cl(Y) for the closure of a subset Y of a topological space X 
and int(Y) for the interior. The spectrum of a matrix A £ R dxd is denoted by cr(A). 
#S denotes the cardinality of a set S. 

2. Preliminaries. In this preliminary section we recall some basic facts on non¬ 
linear control systems, mainly to introduce some notation, and we also recall some 
properties of topological entropy for dynamical systems. 

2.1. Control systems. Let d,m. £ N, M be an open subset of R d , and U C R m 
be compact. Let / : M x R m —> be a continuous mapping such that the partial 
derivative with respect to the first argument exists and depends continuously on both 
arguments. Define the set of admissible control functions by 

U := {u : R. —> R m | u measurable and u(t) £ U a.e.} . 

The shift, flow on U is given by 

0:lxW->W, 0 (t, u) := O t u with (0 t u)(s) := u(t + s) for all t,s £ R. 

The family 

(2.1) x(t) = f(x(t),u(t)), u£U, 

of ordinary differential equations is called a control system. For given initial value x £ 
M and control function u £ U the solution of the initial value problem x(0) = x will be 
denoted by ip(t, x, u). Note that </?(•, x, u) is only a solution in the Caratheodory sense. 
That is, ip(-,x,u) is an absolutely continuous curve which satisfies the corresponding 
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integral equation. Throughout we assume that solutions are defined globally. This 
assumption is justified by the fact that we consider only trajectories which do not 
leave a compact subset of the state space M (cf. Sontag [14, Prop. C.3.6]). Thus we 
obtain a cocycle ip :Rx M xM —> M, i.e., 

(2.2) ip(t + s, x, u) = <p(s, ip(t, x, u), Qtu) for all t, s £ R, x £ M, u £W. 

The positive and negative orbits from x £ M at time t > 0 are 

Of (x) = x,u) | u £ U} , O(x) = {ip(—t, x,u) | u £ Id} . 

For T > 0 we denote 

of T (x)= y of(x), o ± (x) = y of(x). 

te[o,T] t> o 

A subset Q of the state space M is called weakly invariant (or controlled invariant ) 
if for all x £ Q there is some u £ U with p(t, x,u) £ Q for all f > 0 and Q is called 
strongly invariant if 0 + {x) C Q for all x £ Q. 

2.2. Topological entropy. We recall the definition of topological entropy for 
a uniformly continuous map / : X —> X on a metric space ( X , d ): For all n £ N a 
metric on X is given by 

d n j(x,y ) := max d(f J (x), f J {y)). 

0<j<n— 1 

For n C N and e > 0 a set E C X is called (n, e)-separated (with respect to /) if 
d n j(x,y) > £ for all x,y £ E with x y. A set F C X (n,e)-spans another set 
K C X (with respect to /) if for all x £ K there is some y £ F with d n j(x, y) < e. 

For a compact set K C X let r(n, e, K , /) be the minimal cardinality of a set 
F which (n, £)-spans I\ , and let s(n, s, K, /) be the maximal cardinality of an (n, e)- 
separated set E C K. Define 

h spa , n (£,K,f) := lim sup-In r(n,e, K, /), h sep (e,K,f) := lim sup - In s(n, e, K, /). 

n—* oo Tl n—*oo Tl 

With these definitions the following statements hold true. (For a proof, see, for in¬ 
stance, Bowen [3, Lem. 1, p. 402].) 

(i) r(n,e,K,f) < s(n,e,K,f) < r(n, §,K, f) < oo. 

(ii) If Ei < e 2 , then ft spa n(£i, K, f) > h span (£ 2 , K, f) and h sep (£!,K,f) > 
hsep}^2-j A”, y). 

Hence the following definitions make sense: 

hto P (KJ) .— lim h span (£, K, f) — lim /i se p(£ ? K-, ,/*), 


^top(/) •— sup hto P (KJ). 

K CX compact 

htop (/) is called the topological entropy of /. In general ht op (f) depends on the given 
metric. But if X is compact, it is a topological invariant. 

Now consider a continuous semiflow <F : Kj x X —> X on the metric space (X, d). 
For brevity we denote the time-f-map <I>(f, •) : X — > X by 4> t . We assume that <I> is 
uniformly continuous in the following sense (cf. section 5 of [3]): 

(2.3) Vf 0 ,£ > 0 : 35 > 0 : Vf £ [0,t 0 ], x, y £ X : d(x,y) < S => d($ t (x),$ t (y)) < £. 


Copyright © by SIAM. Unauthorized reproduction of this article is prohibited. 



1704 


FRITZ COLONIUS AND CHRISTOPH KAWAN 


We want to define the topological entropy of 4> in a way analogous to how we did for 
maps. To this end, we introduce for every real number T > 0 the metric 

d T ,<i>(x,y) ■■= max d($ t (x),®t(y))- 

te[o,T] 

As for maps we can define (T, e)-separated and (T, c)-spaiining sets. For instance, we 
call a set E C X (T, e)-separated if for all distinct x,y € E one has dT.<s>(x,y) > e. 
If K C X is a compact set, the quantities r(T, e, K, 4>), s(T, e, K, 4>), /i span (e, A", 4>), 
h sep (e,K,$), ft t0 p (A', 4>), and ft top (41) are defined just as for maps. 

The following lemma, which will be needed in section 5, relates the topological 
entropy of a semiflow to the topological entropy of a map. 

Lemma 2.1. The topological entropy of the semiflow 4) equals the topological en¬ 
tropy of its time-one-map fttop(4 ) ) — ft top (^i). 

Proof. Fix a compact set K C X and real numbers T,e > 0. Let F C X be a 
set which (T, e)-spans K with respect to the semiflow 4> and define n g N to be the 
greatest natural number such that n — 1 < T. Then for every x € K there is some 
y £ F with max te [ 0) T] d($ t (x),&t(y)) < £• Since = (4>i)- 7 for all j £ No this implies 

dn,*! (x, y) = max d(($ 1 ) 3 (a;),(f 1 ) 5 (j/)) < max < £■ 

0<j<n—l tS[0,T] 

Thus F (n, £)-spans the set K with respect to the map 4>i, which implies that 
r(n, £, AT, 4>i) < r(T, e, K, 4>). It follows that 

fts P an(o, AT, 4>i) = lim sup — In r(?z,£, A", 4>i) < lim sup — In r(n, e, K, 4>) 

n—^oo Ti n —>-oo Ti 

< lim sup ^ In r(T, £, K, 4>) = ft spa n(£, K,$>). 

T—>oo 1 

Consequently, ft sp an( < f ) i) < ft s pan(4 > ). In order to show the converse inequality, let 
T, £ > 0 and choose 5 = 5(e) according to (2.3) with t 0 = 1. Let n £ N be the smallest 
natural number such that T < n — 1 and let F C X be a set which (n, (5)-spans K with 
respect to 4>i. Then for every x £ K there is some y £ F such that d n ^ 1 (x,y) < 6. 
For every t £ [0,T] there are unique j £ {0,l,...,n — 1} and s £ [0,1) such that 
t = j + s, which implies 

d($ t (*),$*(!/)) = <*($,($,•(:!;)), $.($j(*))) 

= ^((^(aO),^*!)^*))) < £• 

Consequently, F is also (T, £)-spanning the set I\ with respect to the semiflow 4>. Now 
for given T > 0 let n = n(T) denote the smallest integer with T < n — 1. Then it 
follows that 

ft sp an(e, K, 4>) = lim sup ^ In r(T, £, K, 4>) < lim sup ^ In r(n, 5, K, 4>i) 

T—► oo J- T—> oo 

< lim sup-— In r(n, 5, K, 4>i) 

n—* oo Tl 2 

= lim sup - In r(n, 5, K , 4>i) = h span (5, K, 4>i). 

n—> oo Tl 

Thus h top (K, 4>) < h top (K, 4>i) and ft top ($) < ftto P ($i)- □ 


Copyright © by SIAM. Unauthorized reproduction of this article is prohibited. 



INVARIANCE ENTROPY FOR CONTROL SYSTEMS 


1705 


3. Definition and elementary properties. This section presents the defini¬ 
tion of several versions of invariance entropy. Basic properties of these notions are 
derived. 

Consider the control system (2.1). Let K, Q C M be nonvoid compact sets with 
K C Q and Q weakly invariant. For given T, e > 0 we call S C U a (T, e)-spanning 
set for (/A, Q) if for every x G I\ there exists u G S with 

<p(t, x, u) G N S (Q) = {p G M | 3 q G Q : d(p , q ) < e} for all t G [0, T]; 

here d denotes the Euclidean distance (note that this notion is different from the one 
used for topological entropy). By r- mv (T, e, K, Q) we denote the minimal cardinality 
of a (T, £)-spanning set. A set S* C U is called T-spanning for ( K,Q ) if for every 
x G K there exists u G S* with 

ip(t,x,u) G Q for all t G [0,T]. 

The minimal cardinality of a T-spanning set is denoted by r* nv (T, K,Q). If there is 
no finite T-spanning set, we define r* nv (T, K,Q) := oo. Let 0 < Ti < T 2 . Since every 
(T 2 ,e)-spanning (T 2 -spanning) set is obviously also (Ti, e)-spanning (Ti-spanning), it 
follows that 

r inv (T lt e,K,Q)< r inv (T 2 , e, K, Q) and r* nv (Ti, K, Q ) < rf nv (T 2 , K, Q). 

Since every (T, £i)-spanning set is also (T, e 2 )-spanning if ey < e 2 , we obtain 

(3.1) n nv (T,e 1 ,K,Q) > r inv (T,£ 2 ,K,Q) for £i < e 2 . 

We define the invariance entropy hi nv (K,Q) and the strict invariance entropy hf nv 
(K, Q ) by 

hin V {e, K, Q) := limsup ^ In r inv (T, e,K,Q), 

oo 1 

^inv(-^ 5 ^ 5 ) •— lim /lin v (^5 ^ 5^)5 
K„ (K, Q) ■ = lim sup i In r* nv (T, K, Q). 

T—>00 1 

From (3.1) it follows that the limit lim e ^o hi nv (e, K, Q) is well defined. If K = 
Q, we often suppress the argument K. Thus we write, e.g., r mw {T, e, Q) instead of 
r inv (T,e,Q,Q). 

Remark 3.1. In general, it is not true that for the strict invariance entropy the 
numbers r* nv (T,K,Q) are finite. Hence we introduce the weaker version h- lnv (K,Q). 
In section 4 we will show that h-, nv (K,Q) as defined above is finite. Compare also 
Example 5.1. 

The following proposition summarizes some basic properties of these quantities. 
Proposition 3.1. Let K,Q C M be nonvoid compact sets with K c Q and Q 
weakly invariant for system ( 2 . 1 ). 

(i) Hn V (T, e, K, Q) < 00 for all T, e > 0. 

(ii) rf nv (T, Q) is either finite for all T > 0 or for none. 

(iii) The function T 1 —> In r* nv (T, Q) is subadditive and consequently 

frfnv ( Q ) = lim ^ In rf nv (T, Q) = inf i In r* nv (T,Q). 

1 —^00 1 1 >u 1 
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(iv) h inv (K,Q) < h* nv (K,Q). 

Proof. 

(i) Since Q is weakly invariant, for every x £ K there exists some u x £ IA with 

y>(Kg",a;, u x ) C Q. Since N e (Q) is open in M and solutions depend continuously on 
the initial value, for every x £ K there exists a neighborhood W x with <p(t, W x , u x ) C 
N e (Q ) for all t £ [0,T]. The family {W x } x ^k is an open cover of I\. By compactness 
one can choose a finite subcover Xi,... ,x n £ K. It follows that S := 

{u Xl ,..., u Xn } is a (T, e)-spanning set for ( K , Q). Hence Tm V (T, e, K , Q) < n < oo. 

(ii) Assume that r* nv (To . Q) < oo for some T 0 > 0. Then 

rfnv (T, Q ) < rf nv (T 0 , Q) < oo for all T £ (0, T 0 ). 

For T > T 0 choose k £ N with kT 0 > T and let S* = {u\,... , u n } be a minimal 
To-spanning set, i.e., n = rf nv (To, Q). For every /c-tuple (*o, *i,..., ik-i) with ij £ 
{1,..., n} for j = 0,1,..,, k — 1 we define a control function £lA by 

i(f) := u i} {t - j’To) for all t £ [jT 0 , (j + 1)T 0 ), j = 0,1,..., k - 1. 

The function Ui 0 ^ lt ... t i k _ 1 may be extended arbitrarily to R\[0, fcTo). By this construc¬ 
tion we obtain n k control functions. Consider the set 

<5 k ■ { u io,ii i I (*0, ilt i *fc—l) € {1,..., ?r} j . 

Now let xq £ Q. Since S* is To-spanning there exists Ui 0 £ S* with <p([0, To], Xo, Ui 0 ) C 
Q. Let Xi := ip(To, xo, ut 0 ). Then again, there exists u^ £ S* with <p([0, To], x\, Uif) C 
Q. Next we define X 2 ■= v?(To, Xi, u^) and repeat this process until, after k steps, we 
have obtained control functions Kj 0 , ..., From the cocycle property (2.2) 

and the definition of it follows that 

V?([0, fcTo],Xo,Uj 0 ,ii,...,4_i) C Q. 

This implies that Sl is a (fcTo)-spanning set and thus 

n*nv( T > Q) < r* nv (kT 0 , Q) < = n k < oo, 

which proves the assertion. 

(iii) If r* nv (T, <2) = oo for all T > 0, the assertion is trivial. So by (ii) we may 
assume that rf nv (T, Q) < oo for all T > 0. With arguments similar to those in the 
proof of (ii) one can show that 

rf nv (T + S,Q)< r* nv (T , Q) • r* nv (S, Q) for all T,S > 0. 

This implies subadditivity of the monotone increasing function T i—> In r,* nv (T, Q ), 
(0, oo) —* Kg. Hence the limit exists and equals the infimum inf ^>0 y In r* nv (T, Q) 
(see [6, Lem. 1.21, p. 14] for a proof of the latter). 

(iv) Every T-spanning set is obviously also (T, e)-spa,lining for all e > 0, and 

thus n nv (T,s,K,Q) < r* nv (T, K,Q) for all T,e > 0. This implies hi nv (e, K,Q) < 
h* nv (K, Q ) for all £ > 0 and hence hi nv (K, Q) < h* nv (K , Q). □ 

Remark 3.2. From Proposition 3.1(h) and (iii) it follows that h.* nv (Q) < oo if and 
only if rf nv (T, Q) < oo for one T > 0 if and only if rf nv (T, Q) < oo for all T > 0. 

In order to compute upper bounds for h- mv ( K , Q) it will be useful to define another 
quantity which will be called the strong invariance entropy for ( K,Q ). To this end, 
we introduce the lift of the weakly invariant set Q , defined by 

Q := {(x, u) £ Q x U | cp(t, x,u) £ Q for all t > 0} . 
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For given T,e > 0 a set <S + C Q is called strongly (T, e )-spanning for ( K,Q ) if for 
every x £ K there exists (y, u) G <S + with 

dT,u(x,y) max d(ip(t,x, u),(p(t,y,u)) < e. 
te[o ,T] 

By r^ v (T,£, K,Q) we denote the minimal cardinality of a strongly (T, ej-spa,lining 
set. As for r lnv (T,e,K,Q ) it follows by continuous dependence on initial conditions 
that r^ v (T, e, K, Q) is finite. We define 

/i+ v (e, K, Q ) := limsup i hi r+ v (T, e, K , Q), 

T^oo J- 

h tnv( K ’Q) '■= l ™ h tn V ( £ ’ K ’Q)- 
e\0 

Obviously, r^ v (T,e,K,Q), considered as a function of T and e, has the same mono¬ 
tonicity properties as rj nv (T, £, K,Q). Again, for K = Q we drop the corresponding 
argument. 

Proposition 3.2. Let K,Q C M be nonvoid compact sets with K c Q and Q 
weakly invariant for system (2.1). Then hi nv (K,Q) < hf nv {K,Q). 

Proof. Let <S + = {(yi, ui),..., {y n , u n )} be a minimal strongly (T, e)-spanning 
set for ( K,Q ) and define S := {u±,... ,u n }. We want to show that S is (T,e)~ 
spanning. To this end, pick x € K arbitrarily. Then there exists i £ {1,..., n} with 
d((p(t,x,Ui),ip(t,yi,Ui)) < e for all t £ [0,T]. Since <S + C Q we have tp(t,yi,Ui) £ Q 
for all t> 0, which implies ip(t,x,Ui ) £ N e (Q) for t £ [0,T]. Hence 

r inv (T, £ , K, Q) < #S < #S+ = r+ v (T, £, K, Q). 

Consequently, also h inv (e, K , Q) < h^ v (e, K, Q) and h inv (K, Q) < h+ nv (K, Q). □ 

In order to prove the next proposition we need the following technical lemma. 
Lemma 3.3. For any functions /i,..., /jv : Kj —»■ (0, oo) (N £ N) it holds that 

lim sup i In ( V f t (T) ] < max lim sup i In /,(T). 

T—>oo 7 J *=1 ,-,N T—>oo t 

Proof. For brevity we write 

A(/) := lim sup ^ In / (T) 

T—»oo 1 

for any function / : Kg' —> (0, oo). We define g : K^ —> (0, oo) by 
g(T) := max /j(T) for all T £ Kg’. 

Then 

A - X ( N9 ^ = h ™ su p ^ i ln ( N ) + Mg( T ))} = Kg)- 

Thus, it suffices to show that A (g) < maxj = i j ... i jv A(/»)• Let (Tfc)fce n> G K)j~, be a 

sequence with T k —> oo and 

A (g)= lim -!r hi max fi(T k ). 

k —>oo Ik i=l,...,N 
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Obviously, there exists an zo G {1,... ,N} such that fi 0 {T k ) = maxj— fi{Tk) for 
infinitely many k G N. Let ( T nk ) k gN be a corresponding subsequence. Then we obtain 

Mff) = , lim J-l n fio( T n k ) < Mfio) < . max A(/i). □ 

k—*oo ±n k i=± 

The following proposition summarizes some more properties of both invariance 
entropy and strict invariance entropy. 

Proposition 3.4. Let K,Q c M be nonvoid compact sets with K c Q and Q 
weakly invariant for system (2.1). 

(i) If there exist finitely many controls Ui ,..., u n G U such that for every point 
x G K there exists i G {1,..., n} with <p(R)(", x, uf) C Q, then 

h inv (K,Q)=h* nv (K,Q) = 0. 

In particular this holds if K is finite or if Q is strongly invariant. 

(ii) For all e > 0 and r > 0 

(3.2) h inv (e, K, Q ) = limsup — Inr inv (nT, e, K, Q). 

n —»oo TIT 

(iii) Let Kf C K, i = 1,..., N, be closed subsets of K with K = (JiLi Ki- Then 

^inv(-^?Q) — ma,X h[ n v(K-ii • 
i=l,...,N 

(iv) Consider for every s > 0 the control system 

(3.3) x(t) = s ■ f (x(t ), u(t )), uGlI. 

Then Q is weakly invariant for each of these systems. Let hi nV)S (K,Q) denote the 
corresponding invariance entropy. Then it holds that 

hinv,s (A, Q') — hi nv (LC , Cf ) for all s 0. 

Assertions (ii), (iii), and (iv) remain valid for the strict invariance entropy. 
Proof. 

(i) From the assumptions it immediately follows that for all T, £ > 0 one has 

r inv (T,£,K,Q) < r* nv (T,K,Q ) < n. This implies yin r* nv (T,K,Q) < —► 0 for 

T —> oo and thus hi nv (K, Q) < h* nv (K , Q ) = 0. 

(ii) Obviously, the left-hand side of (3.2) is not less than the right-hand side. In 
order to show the reverse inequality, let (T k )ken be a sequence converging to oo. Then 
for every k G N there exists G N such that n k r < T k < {n k +1 )r, and n k —> oo for 
k —> oo. If Ti < T 2 , then ri nv (Ti, e, K. Q) < r- lm (T 2 ,£, AT, Q), which implies 

Finv (T k ? £? A , Q'j A Ti nv ((li fe “t“ 1 )t, S', AT, Q ) 


and consequently 


Jr Inr inv (T fe , e, A', Q) < —lnr inv ((n fc + l)r, e, K, Q). 

d k TikT 

This yields 


limsup — lnr inv (T fc , s, K, Q ) < limsup-lnr inv ((n fc + l)r, e, AT, Q). 

fe—>-oo k k —>00 n k r 
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Since 


1 n k + 1 1 

-In r inv ( (rife + l)r, e, K, Q) = — - - -——In r inv ((n k + l)r, e, K, Q) 

n k T n k (n k + ljr 

and nk+1 —> 1 for k —» oo, we obtain 

nk 5 


lim sup — In r inv (T k ,e,K,Q) < limsup --In r inv (n k T,e,K,Q) 

k—> oo ' k k —>oo n k T 


< lim sup — In r inv (hr, e, K , Q). 

k—*oo 


This proves the claim. 

(iii) If S is a minimal (T, e)-spanning set for (K, Q), then S is also (T, c)-spa,lining 
for ( Ki , Q). Thus we obtain n nv (T, e, Ki, Q) < r- lnv (T, e, K, Q ), implying 

max hi nv (Ki, Q) ^ h[n V (K, Q'j. 

On the other hand, if 5, is a minimal (T, ej-spanning set for (Ki, Q), i = 1 ,... ,N, 
then S := IJ^-, S, is (T, e)-spanning for (K,Q). This yields 

JV N 

r inv (T, e, K, Q)<#S<J2 r ™( T ' £ ' Ki ’ Q )■ 

i= 1 i =1 


By Lemma 3.3 we obtain 


AT 


ft. in v(e, K, Q) < lim sup — In V' r inv (T, e, K t , Q) < 

m J Z ' 


max h[ nv (£, Ki, Q'j, 

i— 


which yields the result. 

(iv) Let <p s denote the cocycle of system (3.3). Let (x, u) € M xU and define 
u(t) := u(ts). Then obviously u €U and for all lei it holds that 

r-t/s rt 

<p a (j,x,u) = x + / sf(ip s (T, x,u),u(t))cIt = x+ / f(ip a (^,x,u),u(T))dT. 

Jo Jo 

This proves that y> s (|, x, u) = ip(t, x, u) for all t € R. From that we can conclude that 
there exists a one-to-one correspondence between the (T, e)-spanning sets of system 
(2.1) and the (-j, e )-spanning sets of system (3.3), which preserves the cardinality. 
This implies r- lm (T, e, K, Q) = r'j nVj .s(-y, s, I\, Q) and thus 


h[nv (^> A, (()) 


lim sup ^ In r inv (T, e, K, Q ) 

T—>oo 1 


= s • lim sup — r inv (^, e, K, Q) = s ■ h inv s (e, K, Q). 

oo sT 


This proves the assertion. 
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Finally, analogous arguments show that assertions (ii)-(iv) are also valid for the 
strict invariance entropy. □ 

Remark 3.3. Proposition 3.4(h) shows that for all time steps r > 0 one obtains the 
same result. Hence from the invariance entropy one cannot deduce any information 
on maximum allowable time steps (cf. also Nesic and Teel [12]). 

The next theorem shows that the invariance entropy cannot increase under semi¬ 
conjugation. 

Theorem 3.5. Consider two control systems x = /( x,u) and y = g(y,v) on M 
and N with corresponding solutions ip(t, x, u) and f){t, y, v) and control spaces U and 
V corresponding to control ranges U and V. Let n : M —> N be a continuous map and 
h :U —*V any map with the semiconjugation property 

(3.4) n(ip(t,x,u)) = ip(t,Tr(x),h(u)) for all x £ M, u£U, t > 0. 

Then 


h inv (n(K),Tr(Q)) < h inv (K,Q) 

if K C Q C M are compact and Q is weakly invariant. The analogous statement holds 
for the strict invariance entropy. 

Equation (3.4) holds, in particular, if n : M —> TV is a continuously differentiable 
map and H : U —> V a continuous map such that 

(3.5) Dw x f(x,u) = g{'K{x), H(u)) for all (x,u) £ M x U. 

Proof. By the assumptions it is clear that n(K) C n(Q) C N are nonvoid compact 
sets. Equation (3.4) implies weak invariance of n(Q) with respect to the system on N: 
If y € 7r(Q), then there exists x £ Q with n(x) = y. Let u £ U be a control function 
with i p(t,x,u) £ Q for all t > 0. It follows that 

%/j(t, y, h(u)) = ip(t, 7r(x), h(u)) ^ = ^ 7r (<p(t, x, u )) £ 7r(Q) for all t > 0. 

Now let T, e > 0. Since 7r is uniformly continuous on the compact set Q there exists 
6 > 0 with n(N s (Q)) C iV e (7r(<2)). Let S C U be a minimal (T, <5)-spanning set for 
( K , Q ) and define S := h(S). For any y £ n(K) there exists x £ K with 7r(x) = y. Let 
u £ S such that <p([0, T], x, u) C Ng(Q). Then h(u) £ S and ^>([0, T], ir(x), h(u)) C 
n(Ns(Q)) C N e (n(Q)). This shows that S is (T, e) -spanning for Con¬ 

sequently, 

hi nv (e, tt{K), 7t(Q)) < h inv (S,K,Q) < h inv (K,Q). 

For e \ 0 we obtain hi m (n{K), tt(Q)) < hi nv (K, Q). It is even easier to see that the 
same inequality holds for the strict invariance entropy. 

In order to see the second assertion, recall that the solution </?(•, x,u) : R —> M is 
the unique absolutely continuous curve with ip( 0, x, u) = x and 

—'pit, x, u) = f(p(t, x, u), u{t)) for all f £ M where —tp(t, x, u ) exists. 
dt ' dt 

By the chain rule we obtain for all t £ R. where 4fP{t, x, u ) exists 

^7r (<p(t,x,u)) = DTr v ( ttXtU )-^p(t,x,u) = Dn v ( tiXjU )f(ip(t, x,u),u(t)) 

(3=5) g(^(p{t,x,u)), H{u{t))). 
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It follows that 7 r(<p(-,x,u)) : R. —> N is an absolutely continuous curve on N with 
7r(ip(0, x, u)) = 7r(x) which satisfies the differential equation y = g(y,H(u)) almost 
everywhere. Let h : U —> V be defined by h(u)(t) := H(u(t)) for all u £ U and teK. 
Since H is a continuous map from U to V, t i—> H(u(t)) is measurable for every 
u £ U and H(u(t )) € V for almost all t £ R, which shows that h is well defined. By 
uniqueness of solutions it follows that 7r x, u )) = n(x),h(u)). □ 

4. General bounds. For simplicity we assume throughout this section that 
M = K d . We will provide rough bounds for h- lnv (K,Q) —one lower and one upper 
bound—which can be computed directly from the right-hand side of the system. Since 
the upper bound is always finite, finiteness of hi nv (K, Q ) also follows. 

In the following proof we denote by div x /(x, u) the divergence of the function / 
with respect to the first variable, i.e., 

di v K f(x,u) = ^2 

i— 1 1 

where fi,... , fd : x K m —> R are the coordinate functions of /. 

Theorem 4.1. Consider control system (2.1) with M = R d . Let K,Q c R d be 
nonvoid compact sets with K C Q and Q being weakly invariant. Then, if the Lebesgue 
measure X d (K) of K is positive , the following estimate holds: 

(4.1) h inv (K, Q) > max < 0, min div x /(x,«) > . 

( x,u)£QxU J 


Proof. For arbitrary T, £ > 0 let S = {mi, ... ,u n } be a minimal (T, e)-spa,lining 
set for ( K,Q ). Define the following sets: 

Kj := {x € K | ip([0,T],x,Uj) C N e (Q)} , j = l,...,n. 

By openness of N £ (Q) and continuous dependence on initial conditions, Kj is open in 
K and hence a Borel set. Since ip(t, Kj,Uj) C N S (Q) for all t € [0, T) and j = 1, .,n 
we obtain in particular 

\ d (tp(T, Kj,Uj)) < A d (N e (Q)) for j = 1,..., n. 

Moreover, by the transformation theorem and Liouville’s trace formula we get for all 
j e n} 


A i {' P {T,K j ,u j )) 


det ^( T,x,uj) 


dx 


> A d (Kj) ■ inf 


(i.ulEitxU, 
V=([0,T].x, u )CJV e (Q) 


det ^( T,x,u ) 


= A d {Kj)- inf exp / div x /(<p(s, x, u),u(s))ds . 

(*.«)ekxu, \ n / 

V=([0,T].x, u )CJV e (Q) / 
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In the rest of this proof, inf( X; „) denotes the infimum over all (x,u) £ K xlA with 
ip([0,T\,x,u) C N e (Q). One finds 


inf exp 

( X,U ) 


div x /(tp(s, x, u), u(s))ds 


(4.2) 


> exp T 


(x,u) £cl( JV e (Q)) x U 


div x /(x, u) 


min 

(x,u)£c\(N e (Q)) x u 


exp (T ■ div x /(#,«)); 


hence the infimum is positive. We may assume that X d (Ki) = \ d (Kj). 

This implies 


X d (K) < V X d (Kj) < n • max X d (KA = n-X d {K 1 ) 

' 7 =l,...,n 

3 =1 


< n ■ 


< n 


X d { i f{T 1 K\,u\)) 


inf( x ,«) exp (/ 0 T div x /(^(s, x, u),u(s))ds 
X d (N £ (Q)) 


info.u) exp (/ 0 T div x /(^(s, x, u), u(s))ds^ 
Consequently, for n = n nv (T, e, A", Q) we obtain the estimate 

mwi) i n U xp (i ■ 


n > 


Taking the logarithm on both sides, dividing by T, and letting T go to infinity yields 
the inequality 

1 f T 

h inv (e, AT, Q) > limsup — inf / di v x f(ip(s,x,u),u(s))ds. 

T—>oo 4 (*.«) Jo 

Again using estimate (4.2) we also find 

i r 

limsup — inf / div x /(<p(s, x, u), u(s))ds 
T—»oo 4 (»,«) Jq 


> limsup min div x /(x, u) = min div x /(x,u). 

T—>oo ( x,u)ecl(N e (Q))xU (x,u)ed(N e (Q))xU 

Letting e tend to zero we obtain (4.1). □ 

The next theorem, whose proof is a modification of [8, Thm. 3.3.9, p. 124], provides 
an upper bound for the strong invariance entropy and hence for the invariance entropy. 
For the proof recall the definition of fractal dimension: Let Z C X be a totally bounded 
subset of a metric space (X,d) and let b(e, Z) be the minimal cardinality of a cover 
of Z by e-balls. Then the fractal dimension of Z is defined by 

dim f(Z) := limsup ^ £lU {oo}. 

e\,o l n (l/£) 
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The fractal dimension depends on the metric and is not a topological invariant. But for 
a relatively compact open subset of a differentiable manifold it equals the topological 
dimension. 

Theorem 4.2. Consider control system (2.1) with M = R d . Let K, Q c be 
nonvoid compact sets with I\ C Q and Q being weakly invariant. Then, with L := 
max( x u ) 6 Q X (7 ||^(a:,u)|| ; the following estimate holds: 

(4.3) hf m {K,Q) < Ldhjip(K) < Ld. 

Proof. Let T, e > 0 be given. Then one can choose a C 1 -function 9 : —» [0,1] 

with compact support such that 

6(x) = 1 for all x G N e {Q) 

holds (see [1, Prop. 5.5.8, p. 380]). We define f(x,u) := 9(x)f(x,u), f : R d x M m —> 
R d . Then / is continuous and continuously differentiable with respect to the first 
argument. Consider the control system 

(4.4) x(t) = f(x(t),u(t)), u£U. 

The right-hand side of this system is globally bounded, and thus solutions exist glob¬ 
ally (see, e.g., [14, Prop. C.3.7]). We denote the cocycle associated with (4.4) by if. 
Note that 


?/>([0, T\,x, u ) C N e {Q) =$■ ip(t, x, u) = ip(t , x, u ) for all t G [0, T). 


Define 


L e := max 

(:r,u)6supp(0) X U 


df , , 

Si {x ' u) 


max 

(x,u)£M. d x U 


df, , 


Then L e is a global Lipschitz constant for / on M. d x U with respect to the first 
variable, that is, 

\\f(xi,u) — f(x 2 ,u)\\<L e \\xi — X 2 \\ for all x\, X 2 G M. d , ueU. 

Note that Q is also weakly invariant with respect to system (4.4) and the lift Q is 
the same for systems (2.1) and (4.4). Also the strongly (T, e)-spanning sets of system 
(4.4) coincide with those of system (2.1). 

Now let S + = {(yi,ui),...,{y n , u n )} C Q be a minimal strongly (T, e)-spanning 
set for (K, Q). Define the sets 

Ni := {x G R d | d T , Ui (x, Vi) < e} , i = 1 ,, .., n, 


where 


dT, Ui (x,yi)= max \\if(t, x, m) - if(t, yi, Ui)||. 
te[o,T] 

It does not matter whether we consider trajectories of system (2.1) or of system (4.4), 
since the trajectory ip(t,yi,Ui) is contained in Q for t > 0 and ip(t,x,Ui) is e-close to 
it up to time T and thus contained in N e ( Q ). By the definition of strongly spanning 
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sets K is contained in U"=i A). Let x G R d be a point with \\x — yi\\ < e LeT e for 
some i G {1,..., n}. It follows that 

(4.5) x, Ui) — ip(t, yi, u,)|| < ||® — yi\\ + L e / \\ip(T,x, m) - Ui)\\d,T 

Jo 

for all t > 0. By Gronwall’s lemma this implies 

|| ip{t,x,Ui) - || < ||a; - yi\\e LeT < e for all t € [0 ,T] 


and hence also 


\\ip(t,x,Ui) - ip(t,yi,Ui )|| < ||x - yi\\e LeT < e for all t G [0,T], 

It follows that x G Ni, and thus N-i contains the ball B e -L e T £ (yi). Now assume to 
the contrary that there exists a cover V of K consisting of (e _ieT e)-balls such that 
N := #V < #5+ = n. Let these balls be centered at points ®i,.. ., Xn G Q , and assign 
to the point ®j a control function Vt with (®j,®j) G Q. Then the ball B e -L e T £ (xi) is 
contained in the set 


Vi := {x G R d | d T , Vi (x,yi) < e} , i = 1,... ,IV. 

Thus, the set {(®i, ®i),..., (®jv, ®jv)} is also strongly (T, e)-spanning, which contra¬ 
dicts the minimality of <S + . It follows that 

r^ v (T,e, K ,Q) < b(e~ LeT £,K). 

We have \w(l/[e~ LeT e)) = ln(e iET e _1 ) = L e T — ln(e), and thus 

\n{e LsT e~ l ) + ln(e) ln(e ieT e _1 ) / ln(s) \ 

L e L £ \ + ln(e isT £ _1 ) J ' 

It follows that 

h? nv ( e,K,Q) = lim sup ^ In r+ v (T, e, K, Q) 

T—KX> 1 

< lim sup — In b{e~ LeT e, K) 

T—>oo T 


T In b(e LeT e 1 K) 

= L e lim sup- — - 

T—KX) 


= L e lim sup 


ln6(e LeT e,K) 


r .r r ln(e L e T e -1 ) /ln(e) x 
T^oo L £ j- (L + , (e L e T F -^) 


= L £ lim sup 


L e 'A ^ ln(e 1 s'f £ - 

ln&(e _ieT £, AT) 

°° ln(e^ T £-l)(l + ln(e Le ( Tg — 1 ) ) 


= L £ lim sup 

T —»oo 


ln&(e LeT £,K) 
ln(e ieT £ _1 ) 


L £ dirnp(A'). 
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The Lipschitz constant L e was used only in (4.5) in order to obtain the estimate 

II f{tl’{T,x,Ui),v i (T)) - f{-i/j(T,yi,Vi),Ui(T))\\ < L £ \\i/j(t, x, Ui) - ip(r,yi,Ui)\\ 

for r £ [0,t]. Since here ip(T,yi,ui) £ Q and, as we have seen later, || ip{r % x,Ui) — 
ip(r,yi,Ui) || < s for all r £ [0,t], the estimate we derived for hf m (e,K, Q) holds also 
with 


L e = max 

Gcl( N e (Q))x U 


d f / X 

ai {x ’ u) 


max 

(x,u)ec\(N £ (Q))xU 


df, x 


As e tends to zero, the so-defined L e tends to L := ma X( XtU )eQx u\\^(x,u)\\ and 
consequently 


Kiv( K > Q) = ^ v ( £ . Q)<( Km L e] dim F (K) = Ldim F (K), 

e\0 \s \0 J 

which proves the assertion. □ 

Example 4.1. With the preceding theorems we are now able to compute the 
invariance entropy for one-dimensional linear control systems of the form 

x(t) = ax(t) + u(t) =: f (x(t ), u(t)), u £ U , 


with a > 0. In general, for one-dimensional control systems Theorems 4.1 and 4.2 
yield 


h\ nv (A, ) C 


df, x 

mm — [x,u), max 
( x,u)(zQxU OX (x,u)eQxU 


df, x 

ai (x ’ u} 


if K has positive Lebesgue measure. Since = a > 0 for the linear control 

system, we obtain h\ m (K. Q ) = a. In the next section we will compute the invariance 
entropy for linear control systems in arbitrary dimensions. 

5. Linear control systems. In this section we compute the invariance entropy 
for control systems on of the form 


(5.1) x(t) = Ax(t) + Bu(t), u£U, 

with matrices A £ K dxd and B £ M dxm and compact control range U. The solutions 
of (5.1) are given by the variations of constants formula: 

(p(t, x, u) — e At x + f e A< ' t ~ s ' > Bu(s)ds. 

Jo 

Theorem 5.1. Let K, Q c be nonvoid compact sets with K c Q and Q being 
weakly invariant. Let Ai,..., A d be the eigenvalues of A. Then the following estimate 
holds: 

ht nv (K,Q)< Y, Re ( A *)- 

i: Re(Ai)>0 

If in addition, K has positive Lebesgue measure, we have 

h i„v (K, Q) = h+ v (. K , Q)= Y Re ( A i) ■ 

i: Re(Ai)>0 
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Proof. The proof is divided into three steps. 

Step 1. We show that hf nv {K, Q) is bounded from above by the sum of the positive 
eigenvalue real parts of A. To this end, consider the linear semiflow <f>(f, :r) = e At x , 
4> : x M. d —» R d . With respect to the Euclidean norm, this semiflow is uniformly 

continuous in the sense of (2.3) since for all to > 0, t £ [0,fo], and x, y £ M. d one has 

\\e At x-e At y\\ = \\e At {x - y)\\ < \\e At \\\\x - y\\ < f max \\e At \\) \\x - y\\. 

Hence by Lemma 2.1 the topological entropy /itop(4?) equals the topological entropy 
of the time-one-map <I>i(;r) = e A x. By [3, Thm. 15] the topological entropy of the 
linear map <f>i is given by 


/itop($i) = ^2 ln l^l’ 

v. Iru|>i 

where p ±,.,., pa are the eigenvalues of e A . Since \pi\ = |e Ai | = e Re ( Ai ) we obtain 

hto P ($) = fttop(^i) = ^2 Re ( A ») = ^2 Re ( A i)- 

i : |e A i|>l i: Re(Ai)>0 

Hence, it suffices to show that h^^K, Q) < /ito P ( < f ) ). To this end, for given T, s > 0 
let E C Q be a maximal (T, e)-separated set with respect to the semiflow <!>, say 
E = {yi ,..., y n }. Then E is also (T, e)-spanning the set Q which means that for all 
x £ Q there is j £ {1,..., n} with 

max ||e At a; — e At yf \ < e. 
te[o,T] J 

Since Q is weakly invariant, we can assign to each yj (j £ {1,..., n}) a control function 
Uj £ U such that </?(lR]j", yj, Uj) C Q. Let S + := {(yi, Ui),..., (y n , u n )} C Q. Since 
(p(t, x, u) — ip(t , y, u) = e At x — e At y for all t > 0, x, y £ R d , and u £li, we obtain that 
S + is strongly (T, e)-spanning for ( Q,Q ) and hence also for (K, Q). This implies 

r+ v (T, e, K, Q) < s(T, e, Q, $) for all T, e > 0 

and consequently hf m (K,Q) < h sev (Q, <h) = h top (Q,®) < h top {$). 

Step 2. Under the assumption that A d (K) > 0 and R.e(A-,) > 0 for all? £ {1,..., d} 
we prove that 


d 

h inv {K,Q) >^Re(Ai). 

i =1 

This is a consequence of Theorem 4.1: Let f(x,u) = Ax + Bu. Then it follows that 

d d 

(x, u) = tr (A) = Xj = Re(Ai). 

2=1 2=1 


di v x f(x,u) = tr^- 
ox 


The last equality holds since nonreal eigenvalues of a real matrix appear as pairs of 
complex conjugate numbers, and thus the imaginary parts in the sum cancel. By (4.1) 
the assertion follows. 
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Step 3. We prove the inequality h- lnv (K,Q) > JU. Re ( Ai )> 0 Re(Aj) under the as¬ 
sumption A d (K) > 0 for arbitrary matrices A. 

If all eigenvalue real parts of A are nonpositive, the assertion is true, since 
hinv(K, Q) > 0 holds anyway. Hence we may assume that there exists at least one 
eigenvalue with positive real part. We write E s , E“, and E c for the corresponding 
stable, unstable, and center subspaces with respect to the flow (t,x) e-> e At x. This 
furnishes the decomposition = E“ ® (E s ® E c ). Consider the projection 

7T : R d -» E“, x ^ x u . 

The map n is obviously C 1 and we can project our control system to E“: Let f(x, u ) = 
Ax + Bu and g(y, u ) = A |e>* y + nBu, g : E“ x U —> E“. Then we have 

Dn x f(x, u) = 7 t(Ax + Bu) = irAx + nBu = Anx + nBu = g(nx, u), 

and thus we can apply Theorem 3.5, which yields 

^inv (■ K,Q)>h inv (nK, nQ). 

Since the projected system on E“ again is a linear control system and all eigenvalue 
real parts of A |e<*: E“ —> E“ are positive, we obtain by Step 2 that 

hinv(K, Q) > Y, Re (A)= Re(Aj) 

AGcr(A|E' u ) i: Re(Ai)>0 

if nK C E“ has positive Lebesgue measure. In order to show the latter, let s = dimE“ 
and let X s denote the s-dimensional Lebesgue measure on E“. Assume to the contrary 
that X s (nK) = 0, and consider the linear transformation 

a : —> im(7r) ® ker(7r), x i—> (nx, x — nx). 

On im(7r) ® ker(7r) let (•, -) e be the inner product given by 

((Wl,t>l), (U2,v 2 )) e = (U\,U 2 ) + (VI,V 2 ), 

where (•, •) denotes the standard inner product of K d . The inner product (•, -) e induces 
a norm || • || e and a Lebesgue measure X e 'i on im(7r) ® ker(7r). Using the transformation 
theorem and the theorem of Fubini we obtain 

X d (K) < X d (n~ 1 nK) = [ X n-^K(x)dx 
JR d 


> im(7r)®ker(7r) 


Xn-iTTK(a 1 (w,v))| det a ^ d(u,v) 


= I det a 1 


= I det ( 


/ / Xtt-i *k(u + v)du dv 

J im(7r) J ker(7r) 

/ / Xa(n~ 1 nK)(u,v)du dv. 

J im(7r) Jk.er(n) 
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Since a(jT 1 irK) = ttI\ x ker(7r) we obtain the contradiction 

\ d (K) < | det cC 1 1 / / XnKxker(^)(u, v)du dv 

«/im(7r) J ker(7r) 


= | det a 1 1 / / XirK{u)Xker(iv){v)dv du 

J im(7r) */ker(7r) 


= I det a 


-ii 


/ker(7r) 


Xker(7r) (t) 



XTTK(u)du dv 


det a 1 1 / Xker( 7 r)(v) A s (t tI<) dv = 0. 

«/ker(7r) ^ v y 


=0 


This finishes the proof. □ 

Remarks 5.1. 

(i) In the case when X d (K) = 0 we cannot make a general statement about 
the exact value of hi nv (K,Q). If, e.g., K is finite, then hi nv (K,Q) = 0. But if the 
projection of K to E“(A) has positive Lebesgue measure in E“(A), then hi nv (K,Q) = 
Ei: Re(Ai)>o Re (Ai) anyway. 

(ii) The existence of a nonvoid compact weakly invariant subset for the linear 
control system (5.1) can be guaranteed if the pair (A, B) is controllable, the matrix A 
is hyperbolic, and the control range U is compact and convex with nonvoid interior. 
Then there exists a unique control set D and its closure Q = cl(D) is compact (see 
Colonius and Spadini [5, Thm. 4.1],). It is easily seen to be weakly invariant. Moreover, 
it has nonvoid interior and hence positive Lebesgue measure. 

At the end of this section we want to show by an example that h( nv (Q) = oo is 
possible even if hi nv (Q) = 0. 

Example 5.1. Consider the linear control system x = — x + u(t) on K with control 
range U = [—1,1] (d = m = 1). Let Q C [—1,1] be an infinite compact set which 
is totally disconnected (e.g., a Cantor set or the closure of an infinite, countable, 
discrete, and bounded set). Then for every x £ Q there exists a unique constant 
control function u x £ U with ip(t,x,u x ) = x for all t > 0, namely u x (t) = x. Thus, Q 
is weakly invariant. Since Q is totally disconnected, each point x £ Q can be kept in 
Q for some positive time T > 0 only by making it a stationary point, i.e., by using 
the constant control function u x . Consequently, since Q is infinite, one needs infinitely 
many control functions to obtain a T-spanning set for Q. By Theorem 5.1 one has 
hinv(Q) = 0 in this case. 

Remark 5.1. In view of this example, it is tempting to conjecture that if h* nv ( K , Q) 
happens to be finite, then it coincides with Q). However, we cannot prove this 

conjecture. 

6. Characterization via finite covers and relation to feedback entropy. 

In this last section we will give an alternative definition for the strict invariance entropy 
h* nv (Q) via finite covers of the set Q. Again, for simplicity we assume that M = R d . 
This definition will reveal a connection to the topological feedback entropy defined in 
[11] and will also provide a clearer view on what is measured by the quantity h? nv (Q). 
Again consider the general control system (2.1). 

For a finite cover A of Q let c(A|Q) denote the minimal cardinality of a subcover. 
We say that a triple (A , v, r) is invariantly covering Q if r is a positive real number, 
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A is a finite cover of Q, and v : A —> U is a map assigning a control function va G U 
to each A £ A with 


if(t, A , va) C Q for all t € [0, t]. 

If Q is invariantly covered by a triple (A,v,t), where A = {Ai, A 2 ,..., A q } is or¬ 
dered, then we set v a := va„ for a = 1,... ,q. For every N £ N and every iV-tuple 
(ao, a\,, ajv-i) €E {1,..., q} N we define the control function 

tWiv.aiv—iW == v aj (t- jr) for all t £ \jr,(j + l)r), j = 0,1,..., N - 1, 

and the set 

(6.1) Qoo,oi,...,ojv_i • {•I' ^ Q I V aQ ,ai,...,aAr-i) ^ ’ J 0, 1 T , IV 1} • 

For every a £ {1,..., q} we define the diffeomorphism 

fa : -» /o(a:) := <p(r, x, v a ). 


This yields 


N—l 

(6.2) Qao,oi,...,ajv-i = ^a 0 FI |^| (faj -1 ° ' ' ' ° /a, 0 /a 0 ) (Aij) 

1=1 

since 

x , w a 0 ,ai,...,Oiv-i) = /oj-i ° ' ' ' ° /a, ° fa 0 

for all j = 1,.... IV — 1 by the cocycle property (2.2). 

Let Mat be the family of all the sets Q ao ,ai,...,a N -i : 


An • {Qao,ai| (^0, ^1, • • • , ®JV-l) £ {1; • • • 5 } • 

Then An is also a finite cover of Q (moreover, it is an open cover if A is an open 
cover, since in this case openness follows immediately from (6.2)): For every x £ 
Q we find at least one IV-tuple (ao, ai,..., ajv-i) (which may be not unique) with 
‘p(jT,x,v a0t a 1 ,...,a N -i) G A aj for j = 0,1,..., N — 1, which follows by the invariant 
covering property of [A. v, r). Now we define 


(6.3) 


KnAAv,r) 


1 lim lnc(.4jv|Q) 

r n^oo N 


It can be easily shown that h* nv (A,v,r) does not depend on the ordering of the 
set A. The existence of the limit above follows from a subadditivity argument: Let 
N, M £ N and let An and Am be minimal subcovers of An and Am, respectively. If 
Q\ Qao,a\....,aN —i ^ An and Q 2 Qbo,bi,...,bM—i ^ Am, then 

Q 1 F (/a,v-l 0 ' ' ' 0 /ai 0 fa 0 ) {Q 2) = Qao,ai,...,aN-l,bo,bi,...,bM-l' 


Consequently, we can define a map a : An x Am 
(Qao,ni,.,,,o«_i) Qb 0 ,b 1 ,...,bM-l) 


Am+n which maps the pair 


Q 


0*0 ,CL± ,...,(Xn 


-1 ^ {fa N -1 O • • • O f ai O f ao ) {Qbo,bi t ...,b M -i) m 
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The image of a is obviously a subcover of Am+n and hence 

c{Am+n\Q) < #a{AN x Am) < #(An x Am) 

= #An ■ if Am = c(A n \Q) ■ c(A m \Q). 

This proves subadditivity of the sequence (lnc(.4Ar|(2))AreN- 

Theorem 6.1. For the control system (2.1) the strict invariance entropy and the 
entropy (6.3) defined via covers satisfy 

(6.4) h* nv (Q) = inf hf nv (A, v, r), 

( A,v,t) 

where the infimum is taken over all triples which are invariantly covering Q. If there 
exists no such triple, then the infimum is defined as oo. 

Proof. If h* nv (Q) = oo, then by Proposition 3.1(iii) r* nv (T, Q) = oo for all T > 0, 
which implies that there exists no invariantly covering triple (A,v,t). Hence, in this 
case the assertion holds. 

Now assume that h* nv (Q) < oo. Let (A, v, r), A = {A\, ..., A q }, be a triple which 
is invariantly covering Q. We will show that 

(6.5) c(^vlQ) > rfn v (Nt, Q) for all N G N, 
which implies 

h* nv (A,v,r) = - lim lnc(^jv|Q) > lim In r * nv ( Nr, Q) = h* nv (Q). 

T N—*oo iV N—>oo 1\T 

The latter equality follows from Proposition 3.4(ii), which also holds for the strict 
invariance entropy. In order to show (6.5) let An be a minimal subcover of An and 
define 


Sn := | 

^ao,ai,...,ajv —i I Qa o ^4 tv| ■ 

Since An is covering Q , for every x £ Q there is (ao, a ±,..., On-i) with x € 
Qao,ai,...,o,v -1 G An- By (6.1) this implies, in particular, <p([0, Nt\, x, v ao , ai ,...,a N _ 1 ) C 
Q , which shows that Sn is (IVr)-spanning and thus (6.5) holds. 

It remains to show that there exists a sequence ( A k ,v k ,r k ) of triples which are 
invariantly covering Q with h* nv (A k ,v k ,r k ) —> h* nv (Q) for k —> oo. To this end, let 
r k := k and let Sk := {v k , ■ .. , v k k } C U be a minimal fc-spanning set for Q. Define 

(6.6) Aj := {x £ Q \ ip([0,k\,x,Vj) C Q} , j = l,...,n k . 

Then A k := {A\,...,A nk } is a cover of Q. Let v k be defined by v k (Aj) := v k for 
j = 1,... ,rik- Then it immediately follows that (A k , v k , r k ) is invariantly covering Q. 
We obtain 


h* nv (A k ,v k ,r k ) 


= I ii m ^<^n\Q) = I inf lnc(^l^|Q) 

k oo N k Ne n N 

< \ \n#A k = \\nr* m {k,Q). 
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Since j In r* nv (k. Q) converges to h* nv (Q) for k —> oo we find for every e > 0 some 
ko € N such that \ lnrf nv (fc, Q) — h* nv (Q) < £ for all k > fc 0 . This implies 

h* nv (Q) < h* nv (A k , v k , r k ) < h* nv (Q) + e for all k > k 0 , 
which proves the claim. 0 

Remark 6.1. The characterization of strict invariance entropy, given in the pre¬ 
ceding theorem, is very similar to the definition of strong topological feedback entropy 
introduced in Nair et al. [11]. The differences are, first, that we consider continuous 
time systems, while topological feedback entropy is defined for time-discrete control 
systems of the form 

x k +i = F(x k ,u k ), k > 0, 

where the state space X is a topological space and the controls Uk are taken from 
an arbitrary set U. Furthermore, here a compact set Q C X with nonvoid interior 
is considered such that there is another compact set Q' C int(Q) with the following 
property: For every xo G Q there is a control uo G U with x\ = F(xo,uo) £ int(Q'). 
This invariance condition—called strong invariance in [11]—differs from the weak 
invariance that we impose on the set Q. For example, if Q is the closure of a variant 
control set with nonvoid interior, then there are always points on the boundary of 
Q which cannot be steered to the interior. The strong invariance condition in [11], 
which is tailored for stabilization problems, also makes it possible to consider only 
open covers of Q. 
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